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WHAT IS CLAIMED IS: 

1 1 . A method for managing infomiation during a meeting comprising 

2 steps of: 

3 recording activities among participants during said meeting to produce 

4 recorded meeting data; 

5 identifying a participant directive by analyzing said recorded meeting data 

6 while said meeting is ongoing, said participant directive representing an action on said 

7 information desired by a participant of said meeting; and 

8 in response to identifying said participant directive, effectuating said 

9 participant directive, 

1 0 thereby facilitating the management of information during said meeting, 

1 2. The method of claim 1 wherein said identifying a participant 

2 directive includes producing textual information from said recorded meeting data and 

3 analyzing said textual information. 

ilJ , 

Ul 1 3. The method of claim 2 wherein said recorded meeting data 

'j^ 2 includes video recordings and audio recordings. 

1=1 

y 1 4. The method of claim 1 wherein said action includes an activity 

□5 2 selected from the group consisting of: document management activities, document editing 

3 activities, messaging functions, establishing communication with a new meeting 

4 participant, and manipulation of said recorded meeting data. 

1 5. The method of claim 4 wherein said document management 

2 activity includes accessing said recorded meeting data during said meeting. 

1 6. The method of claim 1 wherein said activities include verbal 

2 communication, written communication, presentation of prepared material using a 

3 projection system. 

1 7. The method of claim 1 further including ascertaining identities of 

2 said participants and selectively effectuating said participant directive based on said 

3 identities. 
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1 8. The method of claim 1 further including tracking locations of said 

2 participants and selectively effectuating said participant directive based on said locations. 

1 9. The method of claim 1 further including locating said participants 

2 in different geographic locations. 

1 iPf A method for providing information services during a meeting 

2 involving two or more participants comprising steps of: 

3 producing a continuous video recording of at least one of said participants 

4 for the duration of said meeting; 

5 producing a continuous audio recording of at least one of said participants 

6 for the duration of said meeting; 

□ 7 storing said video and said audio recordings in a data store; 

{f^ 8 detecting a participant directive based on either or both of said video 

^ 9 recording and said audio recording; and 

fy 10 providing one or more information-related services based on said 

Ln 

S ; 11 participant directive; 

12 thereby providing information-related services based on gestures and vocal 

hi 13 utterances made by said participants during said meeting. 

1 11. The method of claim 10 wherein said detecting a participant 

D 2 directive includes receiving participant input from an input device. 

1 12. The method of claim 10 wherein said detecting a participant 

2 directive includes analyzing textual information contained in either or both of said audio 

3 and video recordings. 

1 13. The method apparatus system of claim 10 wherein said detecting a 

2 participant directive is based on the context of the meeting, 

1 14. The method of claim 10 wherein said detecting a participant 

2 directive includes detecting an information retrieval cue, said method further including: 

3 producing certain information based on said information retrieval cue, including 

4 accessing said data store to retrieve one or more segments of said video and said audio 
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5 recordings and accessing one or more databases to retrieve information contained therein; 

6 and presenting said certain information to one or more of said participants. 

1 15. The method of claim 14 wherein said detecting an information 

2 retrieval cue includes receiving participant input from an input device. 

1 16. The method of claim 14 wherein said presenting certain 

2 information is a step of presenting said certain information to less than all of said 

3 participants. 

1 17. The method of claim 14 further including tracking locations of said 

2 participants, wherein said presenting said certain information is a step of selectively 

3 presenting said certain information based on said locations. 

1 18. The method of claim 10 wherein said information services include 

2 accessing information, editing information, assimilating information to produce new 

3 information, establishing communication with a new participant, transmitting and 

4 receiving messages, accessing a global information network, and accessing a local 

5 network. 

1 19. The method of claim 18 wherein said messages include electronic 

2 mail. 

1 20. The method of claim 10 wherein provision of said information 

2 services depends on permissions associated with said participants. 

1 21. The method of claim 20 further including identifying said 

2 participants to determine associated permissions. 

1 22. The method of claim 10 further including locating said participants 

2 in geographically distinct locations. 

1 25^ A system for providing information services during an interaction 

2 between two or more participants, comprising: 

3 a video capture component configured to produce a continuous video 

4 recording of at least one of said participants; 
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an audio capture component configured to produce a continuous audio 
recording of at least one of said participants; 

a data storage component containing information, said data storage 
component in communication with said video and audio capture components and 
configured to store said video and audio recordings; 

a detection component in communication with said video and audio 
capture components and configured to detect a participant directive by analyzing either or 
both of said video and audio recordings; and 

a service provision component in communication with said data storage 
component and configured to provide an information service based on said participant 
directive, 

thereby providing information services during said interaction based on 
gestures and vocal utterances made by said participants. 

24. The system of claim 23 wherein said participant directive is an 
information retrieval cue, and wherein said service provision component is further 
configured to retrieve certain information from said data storage component in response 
to said information retrieval cue and to provide said certain information to said display 
component. 

25. The system of claim 24 wherein said certain information includes 
said continuous video recording and said continuous audio recording. 

26. The system of claim 23 further including a user input portion 
configured to receive user-provided input data, said detection component further 
configured to identify a participant directive from said user-provided input data. 

27. The system of claim 23 further including a participant 
identification component, said service provision component being further configured to 
selectively provide said information service based on identities of one or more of said 
participants. 

28. The system of claim 27 wherein said identities have associated 
permissions, said service provision component being further configured to selectively 
provide said information service based on said permissions. 
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1 29. The system of claim 27 wherein said participant identification 

2 component is configured to provide participant locations, said service provision 

3 component being further configured to selectively provide said information service based 

4 on said participant locations. 

1 30. The system of claim 23 wherein said information service includes 

2 providing access fiinctions over a communication network. 

1 31. The system of claim 30 wherein said information service includes 

2 data retrieval fi-om a global communication network. 

1 32. The system of claim 30 wherein said information service includes 

2 data retrieval fi-om a plurality of web sites. 

1 A method of utilizing plural information sources to enhance 

nJ 2 information management during a meeting between two or more attendees, comprising: 
Ui 3 producing and storing a continuous audio-visual recording of one or more 

y 5 4 of said attendees, said audio-visual recording comprising a video data component and an 

B 5 audio data component; 

T% 6 extracting and storing textual information from said audio and video data 

D 7 components; 

Q 8 extracting and storing image information from said video data component; 

9 detecting attendee action cues from said audio and video data component 

10 including analyzing said textual and said image information; 

1 1 accessing certain information from said information sources based on said 

12 attendee action cues; and 

13 presenting said certain information, 

14 thereby providing information services during said meeting on the basis of 

15 the actions of said attendees. 

1 34. The method of claim 33 wherein said accessing certain information 

2 includes searching through said audio-visual recording. 

1 35. The method of claim 33 wherein said detecting attendee action 

2 cues includes receiving explicit commands from an attendee. 
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1 36. The method of claim 33 further including tracking locations of said 

2 attendees, said presenting certain information being based on said locations. 

1 37. The method of claim 33 further including editing information in 

2 said information sources based on said attendee action cues; and producing new 

3 information by assimilating portions of information in said information sources based on 

4 said attendee action cues. 

1 38, The method of claim 33 further includes identifying said attendees 

2 from said audio and video data components to produce attendee identifiers. 

1 39. The method of claim 38 further including manipulating information 

2 in said information sources based on said attendee action cues and said attendee 

3 identifiers. 

1 40. The method of claim 39 wherein said manipulating information 

2 includes editing said information. 

1 41. The method of claim 33 further including locating said attendees in 

2 different parts of the world. 

Q 1 ^03^ A system to facilitate the management of information during a 

^ 2 meeting between two or more attendees, comprising: 

□ 3 an information storage portion configured to receive and store information 

4 and to access and provide information; 

5 an audio-visual capture portion in communication with said information 

6 storage portion and configured to produce real-time video recordings and real-time audio 

7 recordings of one or more of said attendees; 

8 a text classification portion in communication with said information 

9 storage portion and configured to produce and store textual information extracted from 

10 said audio and video recordings; 

11 an image classification portion in communication with said information 

12 storage portion and configured to produce and store image information in said video 

13 recordings; 
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a cue detection portion configured to detect attendee action cues from said 
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textual inforniation during said meeting; 
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an infonnation retrieval portion in communication with said information 
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storage portion and configured to access information therefrom based on said attendee 
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action cues; 




19 


an information manipulation portion in communication with said 




20 


information storage portion and configured to manipulate information stored therein 
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based on said attendee action cues; and 
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an information presentation portion operatively coupled to said 




23 


information retrieval portion and said information manipulation portion and configured 
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to display retrieved and manipulated information, 
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wherein information including said textual information and said image 
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information can be retrieved and manipulated by gestures and voice input of said 
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attendees during said meeting. 
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43. The system of claim 42 further including an attendee identification 




2 


portion coupled to said information storage portion and configured to identify said 
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attendees from said audio and video recordings and to provide attendee identifiers. 
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44. The system of claim 43 wherein said information presentation 




2 


portion is further configured to selectively display said retrieved and manipulated 
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inionndiion to diienuees uepenuing on bdiu diicnucc luemiiicrb. 
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45. The system of claim 42 wherein said attendee action cues include 




2 


directives to access said video and audio recordings of said meeting. 
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46. The system of claim 42 wherein said cue detection portion is 




2 


further configured to detect said attendee action cues on the basis of the context of said 




J 


meeung. 
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47, The system of claim 42 further including an attendee tracking 




2 


portion configured to track movements and locations of said attendees. 
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48. The system of claim 47 wherein said information presentation 




2 


portion is further configured to selectively display said retrieved and manipulated 
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information to attendees depending on said attendee identifiers, said attendee cues, and 
said locations of attendees. 

49. The system of claim 47 wherein said attendee identification portion 
includes creating new identifiers for unknown attendees. 
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